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Abstract. In this paper we study the interior transmission problem and 
transmission eigenvalues for multiplicative perturbations of linear partial dif- 
ferential operator of order > 2 with constant real coefficients. Under suitable 
growth conditions on the symbol of the operator and the perturbation, we 
show the discreteness of the set of transmission eigenvalues and derive suffi- 
cient conditions on the existence of transmission eigenvalues. Wc apply these 
techniques to the case of the biharmonic operator and the Dirac system. In 
the hypoelliptic case we present a connection to scattering theory. 



1. Introduction 

Let V e L°°[MP) be compactly supported with supp {V) = Q, where f2 C M" is a 
bounded domain, and let Po{D) be a partial differential operator of order m > 2 
with constant real coefficients 



Po(-D) = ^ aaD"', aa G M, Dj = -i^:—, ? = 1 n. 



■ ^ 

^ dx 



|a|<m 

For any (/? G C^{Q), we set 

||^||p„ = llPoPVII- (1.1) 

Here and in what follows the notation || ■ || stands for the standard L^-norm. The 
completion of C^{Q) with respect to the norm (1.1) is denoted by H^^i^). 

The interior transmission problem is the following degenerate boundary value 
problem, 

(Po -X)v = in Q, 
{Po + V-\)w = in n, (1.2) 
v-we H^"{n). 

We say that A G C is a transmission eigenvalue if the problem (1.2) has non-trivial 
solutions 7^ G Lf^^ and 7^ w G Lf^^. 
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The problem (1.2) arises naturally in the study of inverse scattering theory for the 
operator Pq + V, when Pq = —A. In this context, the significance of the notion 
of a transmission eigenvalue is twofold. On the one hand, in reconstruction 
algorithms of inverse scattering theory, such as the linear sampling method of 
Colton and Kirsch [2, 8], and the factorization method of Kirsch [20], transmission 
eigenvalues correspond to frequencies that one needs to avoid. The fact that they 
form a discrete set makes this possible. On the other hand, the knowledge of the 
transmission eigenvalues carries information about the scatterer [23], and in the 
radially symmetric case, they determine the potential completely [4], see also [21] 
for the previous work in this direction. It is therefore natural to investigate the 
question of existence of transmission eigenvalues, and relate their properties to 
the properties of the scatterer. 

The interior transmission problem was first introduced in 1988 by Colton and 
Monk [10] in connection with an inverse scattering problem for the reduced wave 
equation. They were led to this problem when studying the injectivity of the 
far field operator. The fact that the interior transmission eigenvalues form a 
discrete set was shown in the Helmholz case in [9]. The problem of existence 
of transmission eigenvalues, however, remained unsolved until recently. When 
Pq = —A, Paivarinta and Sylvester in [23] proved the first existence result, and 
soon thereafter, the existence of an infinite set of real transmission eigenvalues 
was established by Cakoni, Gintides, and Haddar in [5]. We would also like to 
mention recent results on transmission eigenvalues for Maxwell's equations, as 
well as for the Helmholtz equation, in the presence of cavities [3, 6, 19]. 

In this paper we consider the case of quite general operators Pq with constant 
coefficients, for which a well developed scattering theory is available [15]. In 
particular, we can allow non-elliptic operators as well as operators of higher or- 
der. We then show the discreteness of the set of transmission eigenvalues, and 
derive sufficient conditions for the existence of an infinite set of real transmission 
eigenvalues. The extension to the case of general operators with constant coeffi- 
cients seems natural, as in applications one frequently encounters such operators 
which could be either non-elliptic, or elliptic of higher order. We also illustrate 
the techniques developed by applying them in two cases of physically significant 
operators, namely the biharmonic operator and the Dirac system in M^. 

Finally, we point out that in view of the non-self adjoint nature of the problem 
(1.2), a study of the distribution of transmission eigenvalues in the complex plane 
would be both interesting and natural. So far, only in the case when Pq = — A, the 
existence of complex transmission eigenvalues has been shown in the very recent 
paper [4], assuming that the index of refraction is constant and sufficiently close 
to one. See also the numerical computation of complex transmission eigenvalues 
given in [11]. 
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The structure of the paper is as follows. In Section 2 we formulate the problem 
and state a compact embedding lemma that is needed when proving the dis- 
creteness of the set of transmission eigenvalues in Section 3, which then follows 
by analytic Fredholm theory. In Section 4 sufficient conditions for the existence 
of transmission eigenvalues are obtained, and the existence of an infinite set of 
transmision eigenvalues is studied in Section 5. In Section 6 we study the refor- 
mulation of the problem which is modeled on the reduced wave, rather than the 
Schrodinger, equation. It is interesting that this problem poses fewer restrictions 
on the operator than the Schrodinger version, and thus even in the second or- 
der case we do not need to assume the ellipticity. Section 7 is devoted to the 
study of two examples from physics, namely, the biharmonic operator and Dirac 
system. In the last two Sections 8 and 9 we explain the relation of transmission 
eigenvalues to scattering theory, relying upon a generalized Rellich theorem. 

2. Interior transmission eigenvalues: The Schrodinger case 

As described in the introduction, let V G L°°(M"') be compactly supported with 
supp (V^) = Q, where Q C M" is a bounded domain, and let Po{D) be a partial 
differential operator of order m > 2 with constant real coefficients. 

Pop) = 5^ fla/^", a„GM, = -z^, j = l,...,n. 

a|<m. 

The following estimate [16, Theorem 2.1], [15, Theorem 10.3.7] 

ll^ll <Cf,||PoP)^||, ^ec^in), 

where is a constant depending on the domain Q, implies that (1.1) is a norm 
on C^{Q), and as already mentioned, completion of C^{Q) with respect to the 
norm (1.1) is denoted by i/(f"(f2); see also [18]. 

Consider the interior transmission problem 

(Pq - \)v = in n, 

{Po + V-\)w = in n, (2.1) 

v-we H^^in). 

We say that A G C is a transmission eigenvalue if the problem (2.1) has non- 
trivial solutions 7^ f G Lf^^.{Q) and w E Lf^^{fl). It suffices to require that 
V ^ 0. Indeed, assume that w = 0. Then v G Hq°{Q,) and extending v by zero to 
the complement of Q, we get {Po — X)v = in M". Since every constant coefficient 
differential operator is injective £^'(M") — )■ £''(]R"'), we have = 0. 

Throughout this work we shall assume that V is real-valued and such that V > 
S > a.e. in Q. 
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We will use also the following equivalent characterization of the space Hq^^H). 
Let 

|q|>0 

and define on C^{Q) the norm 

ll'^ll|o= Ell^o"'(^)'/'ll'- (2.2) 

|a|>0 

The estimate [16, Lemma 2.8] 

\\Pt\DM < Cn,a\\PoiD)^l V e C^{^). (2.3) 

yields that the norms (1.1) and (2.2) are equivalent on if^°(n) 

The space HQ"{Vt) is isometrically imbedded into the space B^p^iW") via zero 
extension to the complement of Vt. Here 

52^p^(M") = {ue S\W) : hu e L2(M")} 

is a Banach space with the norm 

u ^ \\Pou\\l2 

introduced in [15, Definition 10.1.1]. The proof of the discreteness of the set of 
transmission eigenvalues depends on the following result. 

Lemma 2.1. Assume that Po(0 ~^ ^ when |^| — > oo. Then the imbedding 
is compact. 

Proof. The claim follows immediately from [15, Theorem 10.1.10]. 

□ 

A condition under which we can apply this result is found with the help of the 
set 

A(Po) = e : A ^ Po(A^ + v) is constant \/r] E M"} (2.4) 

Then [15, Proposition 10.2.9] implies that -Po(0 — > oo as |^| — oo provided that 
A(Po) = {0}, i.e. there are no hidden variables in -Po(0- 
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3. Discreteness of the set of transmission eigenvalues 

Proposition 3.1. A complex number X is a transmission eigenvalue if and only 
if there exists ^ u E H/^° satisfying 

{Po + V - X)^{Po- X)u = m V'{Q). (3.1) 

Proof. Assume that A is a transmission eigenvalue. Then there exists a non-trivial 
solution {v,w) 7^ of (2.1). Define u = v-w e H^°{^). Then (Pq - A)u = Vw 
and thus, 

{Po + V- X)^{Po - X)u = {P, + V- X)w = 0. 
To see the reverse implication, we first claim that 

(Po + V- A)i(Po - A) = (Po - A):^(Po + V-X). 

Indeed, 

{Po + V- A)i(Po - X)u - (Po -X)^{Po + V- X)u 
= (Po - A)i(Po - X)u +^{Po- A)n - (Po - A)i(Po - X)u 
-(Po-A)^« = 0. 
Let 7^ M G Hq'^{^1) be a solution of (3.1). Denote now 

w = y{Po — A)m and v = y{Po + V — X)u. 



Then 
and 



(Po-A)i; = 0, {Po + V-X)w = in 
v-w = ^{Po + V -X-Po + X)u = ue H^^rt). 



Set 

TA = (Po + V-A)i(Po-A). 
Let A G C. Then for (f,ipE C^{Q), we define a sesquilinear form 



□ 



which extends uniquely to a continuous sesquilinear form on Hq°(Q,) x Hq°(Q,). 
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Lemma 3.2. Assume that either Pq{C,) or —Pq{C,) is bounded from below onM". 
Then there exists Aq G M such that the sesquilinear form Bx^{u,v) is coercive on 

Proof. Let ^ E C^{n) and set Cq = infn l/V > 0. Then 

Bx{(p, v?) = {{Po - A):^(Po - A)</9, (p)L^n) + {{Po - >^)v, ¥^)L^n) 

> Co{{Po - A)V, 'P)L^n) + {{Po - A)v?, (p)L^n) (3^2) 
= Co\\Po^f-2CoX{PoV,v)LHn) 

+ x^Coyf - xyf + {Pov, v)mn)- 

To estimate the last term in the right hand side of (3.2) we write 

{Po^,^)LHn) < llPo^llllv^ll < ^WPovf + ^yf- (3.3) 

For the second term in the right hand side of (3.2), assuming, to fix the ideas, 
that Po(0 is bounded from below on M", we get 

{PoV,v)mn) = (27r)-" / Po{0\m\'d^ > -CM'- (3-4) 

Now combining (3.2), (3.3) and (3.4), we can find Aq G M with |Ao| large enough 
such that 

i?Ao(^,^) > Ylin^ir = e c^{n). 

This estabhshes the coercivity of Bx^ on iJ(f°(r2) x Hq°{Q). 

□ 

Let us denote by H~^''{n) the dual of the space i^o^°(l^). Notice that H~^"{n) 
can be viewed as a subspace of the space of distributions V'{Q). 

Theorem 3.3. Assume that Po(0 ~^ ^ when |^| — 00 and that the symbol 
±Po(0 bounded from below on M", for one of the choices of the sign. Then the 
set of transmission eigenvalues is discrete. 

Proof. The proof is based on application of the analytic Fredholm theory to the 
holomorphic family of operators 

Tx-.C^ C{H^'{n), //-^"(fi)), Tx = {Po + V- A)l(Po - A). 

Since by Lemma 3.2 there exists Aq G M such that the sesquilinear form Bx^, 
corresponding to the operator Txg, is coercive and bounded on H^°{n) x H^°{n), 
by an application of the Lax-Milgram lemma we conclude that Txg : H^°{Q) — t- 
H~^°{Q) is invertible. 
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Now, for any A the operator 

- = -Po^ - - (A - Ao) + ^ : ^ 

(3.5) 

is compact. Indeed, the last two terms in the right hand side of (3.5) are compact 
because 

~{\ - Xo) + : L\n) ^ L\n) 

is bounded and by Lemma 2.1 the embedding Hq°{^1) L^(f2) is compact. The 
second term in the right hand side of (3.5) defines the operator — ^^° Pq. This 
operator is compact as a composition of the bounded operators 

with the compact inclusion L'^{Q) into H~^'-'(Q). The first term in the right hand 
side of (3.5) defines the operator — Pq^^^- This is a bounded operator 

Since the inclusion Hq°{^1) to L^(r2) is compact, we conclude the compactness of 
— Pq as an operator from H^"{Q) to H~^°{Q). Thus also Tx — T\q is compact. 

Hence, the operator Tx is Fredholm as the sum of an invertible operator and a 
compact operator. Since it is invertible at A = Aq, the analytic Fredholm theory 
guarantees that Tx is invertible except for a discrete set of values A. 

□ 



Remark 3.1. The assumptions of Theorem 3.3 are satisfied automatically when 
the operator Pq is elliptic. 

Remark 3.2. The condition that ±Po(.^) is bounded from below on M", for one of 
the choices of the sign, cannot be removed completely. Indeed, let Pq = Dx-^^ + Ax', 
X = {xi,x') G M". Then if {v,w) is a pair of transimssion eigenfunctions for a 
transmission eigenvalue A on some domain Q, then v'{x) = e^^^^v{x) and w'{x) = 
e^i^^^w{x) will be transmission eigenfunctions for the transmission eigenvalue A+/i. 
Hence the set of transmission eigenvalues is either empty or C 

Remark 3.3. Notice that ind(T;v) = 0, since Tx is the sum of an invertible operator 
and a compact operator. It follows that Tx fails to be invertible if and only if Tx 
is not injective. 
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4. Existence of transmission eigenvalues 



In this section we study the question of existence of transmission eigenvalues. Let 
us write the operator Tx in the following form, 

V 1 V V 

Tx = {Po + j- A)-(Po + ^ - ^) - J- (4-1) 

Lemma 4.1. The operator Tx given by (4.1), equipped with the domain 

V{Tx) = {ue H^^n) : P,{^P, - A)n e L\n)}, 
is an unbounded self-adjoint operator on L'^{fl), for any A G M. 

Proof Let Ax = y^{Po + ^-X). Then Ax with the domain V{Ax) = H^^in) is a 
densely defined closed operator. Its L^-adjoint is given by A*^ = {Pq + y — X)yT/2 
with the domain V{A*x) = {u e L'^{Q) : Pq^u e L'^{Q)}. Then the result 
follows from the fact that Tx = AlAx - j. □ 

For future reference, let us remark that the form domain of the semibounded self- 
adjoint operator Tx is Hq°{^1), for any A G M. Let us also recall the corresponding 
quadratic form 

Bx{u,u) = (i(Po - A)n, {Po + V- X)u)L2^a), u G 
From Lemma 3.2, we know that there exists Aq G M such that Bxq is coercive on 

Similarly to [23], we have the following result. 

Theorem 4.2. If for some A G M, there is u E HQ"(il) such that 

Bx{u,u)<0 (4.2) 

then there exists a transmission eigenvalue A* G (Aq, A] , if Xo < X, or X* G [A, Aq), 
ifXo > X. 

Proof. The operator Tx has a compact resolvent acting on L^{Q) because the 
canonical embedding of its domain T>{Tx) to L'^{VL) is compact. The facts that 
Tx depends continuously on A, Tx is self-adjoint with compact resolvent and the 
form domain of Tx does not depend on A imply, through an application of the 
variational principle, that the eigenvalues of Tx depend continuously on A for 
A G M. See [23] for the details of this argument. 

The hypothesis (4.2) yields that Tx has at least one non-positive eigenvalue. Since 
is positive definite, the lowest eigenvalue, which is a continuous function of 
A G M, must pass through zero for some A* G (Aq, A], if Aq < A, or A* G [A, Aq), if 
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Aq > A. Hence, the operator T{ is non-injective and therefore, A* is a transmission 
eigenvalue. 

□ 

We define the muhiphcity of a transmission eigenvalue A to be the multiplicity 
of zero as an eigenvalue of Tx- Since the self-adjoint operator Tx, A G M, has a 
compact resolvent, the multiplicity of A is finite. 

As in [23, Lemma 14], we get the following result on existence of more than one 
transmission eigenvalues. 

Lemma 4.3. // there exists A G M and a p- dimensional subspace C Hq°{Q) 
such that 

Bx{u,u)<0 (4.3) 
for all u G , then there exist p transmission eigenvalues, counting with multi- 
plicity. 

The next result tells us that if the potential is strong enough then the transmission 
eigenvalues exist. 

Lemma 4.4. Let V{x) > 6 > 0. If there exists a p-dimensional subspace C 
H^^'in) such that 

\m 

for all ^ u E , then there exist p transmission eigenvalues, counting with 
multiplicity. 

Proof. We have 

Bx{u, u) = {^{Po - X)u, (Po - A)m) + ((Po - A)m, u) 
1 2A 

< -\\Pou\\' - —{Pou, u) + -\\uf + (Pou, u) - \\\u\\\ 
Choosing A = 5/2, we get 

1 S 

Bxiu,u) < -\\Pouf--\\uf. 
4 

The claim follows by an application of Lemma 4.3. □ 



5. Existence of infinitely many transmission eigenvalues 



Now assume, as before, that Po(-D) is a partial differential operator of degree 
m > 2 with constant real coefficients and Po(0 ^ when |^| — ^ oo and the 
symbol ±Po{C,) is bounded from below on M", for one of the choices of the sign. 
Let e > and consider an open ball Pe(0) C of radius e centered at the origin. 
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Consider the following interior transmission problem for the ball B^[0) and an 
arbitrary constant potential 6 > 0, 

{Po-\)v = in Be{0), 
{Po + S-\)w = in 5,(0), (5.1) 

Notice that as the operator Pq has constant coefficients and 5 is a constant, 
if there exists a transmission eigenvalue X{e) for the ball B^^O), then X{e) is a 
transmission eigenvalue for an arbitrary ball in of radius e. 

Existence of an infinite discrete set of real transmission eigenvalues when Pq = 
—A in R*^, n = 2,3, was obtained in [5]. The proof relies on an explicit computa- 
tion in the case of a constant potential when f2 is a ball, combined with a specific 
analytic framework of generalized eigenvalue problems. 

Following the approach of [5] , we have the following conditional result on existence 
of an infinite set of real transmission eigenvalues for general operators. In the 
proof we give a direct argument relying upon Lemma 4.3. 

Proposition 5.1. Let V G L°°(M") be real-valued compactly supported with 
supp (y) = Q and assume that 

V >6 > a.e. inli. 

Furthermore, assume that for any £ > 0, there exists a real transmission eigen- 
value for (5.1). Then the problem (2.1) has an infinite set of real transmission 
eigenvalues. 

Proof. For every p G N, there exists e > small enough such that Vt contains p 

disjoint balls Bl, . . . ,B^ of radius e, i.e. Bl (Z Vt, i = 1, . . . ,p, and Bl n Bi = 
for i 7^ j. Let X{s) G M be a transmission eigenvalue for (5.1). Then it 
is a transmission eigenvalue for each of the balls Bl with potential 6. Thus, 
Proposition 3.1 implies that there are ^ u'^{e) G Hq°{BI) such that 

{Po + 6-Xie))^iPo-X)u\e) = in V'{Bl), t = l,...,p. 

The extension by zero of u\e) to the whole of Q is in HQ°{n). Moreover, 
the functions u^, . . . ,11^ form an orthogonal system in if(f°(f2), since they have 
disjoint supports. This implies that 



(i(Po - mW, {Po + S- X{e))u^)mn^ = 0, t,j = l,...,p. 
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Set = span{u\ ...,uP}. Let u e Vp. Then 

Bxie){u, u) = (i(Po - A(£))n, {Po + V- X{e))u)L2^n) 

= {^{Po - A(e))n, (Po - m)u)LHn) + {^piPo - A(e))n, Vu)L^n) 
< (^(Po - m)u, (Po - Xie))u)mn) + {{Po - \ie))u,u)mn) 

= (^(Po - Xis))u, (Po + 5 - A(£))n)i2(n) = 0. 

Hence, it follows from Lemma 4.3 that problem (2.1) has p transmission eigen- 
values, counting with multiplicity. As p is arbitrary, the result follows. 

□ 



6. The generalized acoustic problem 

Let V G L°°(R") be compactly supported in with supp (V^) = Q, where 
C M" is a bounded domain, and Po(-D) be a partial differential operator of 
degree m > 2 with constant real coefficients. 

As in physics, while the problem 

(-A - A + = 0, 

models the time-independent Schrodinger equation, the equation 

(-A-A(l + V^))n = 

describes acoustic wave propagation with refractive index 1 + In this section, 
we study the interior transmission problem for the latter, where —A is replaced 
by a general Pq. This problem has the following form, 

(Po - X)v = in n, 

{Po-\il + V))w = in n, (6.1) 

v-we H^"{n). 

We say that A G C is a transmission eigenvalue if the problem (6.1) has non- 
trivial solutions 7^ G Lf^^{Q) and 7^ w G Lf^^{Q). It suffices to require that 
V ^ 0. Notice that A = is always a transmission eigenvalue for (6.1). 

We shall assume that V is real-valued and such that V > 6 > a.e. in Q. 

As in Proposition 3.1, one can show that 7^ A G C is a transmission eigenvalue 
if and only if there exists 7^ n G iJ(f"(r2) satisfying 

Txu = iPo-X{l + V))^iPo-X)u = in V'{Q). 
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Define a sesquilinear form 

wliicli extends uniquely to a continuous sesquilinear for on HQ°(il) x HQ°(il). 
Then Bq is coercive in the sense that there exists Co > such that 

Arguing as in Theorem 3.3, we get the following result. 

Theorem 6.1. Assume that Po(0 ~^ oo when \^\ — oo. Then the set of trans- 
mission eigenvalues is discrete. 

Remark that the multiplicity of each transmission eigenvalue except A = is 
finite. 

Notice that the assumption in Theorem 3.3 that the symbol ±Po(0 is bounded 
from bellow on M", for one of the choices of the sign, is not needed in the 
Helmholtz case. In particular, the results of this section are applicable when 
Pq = D^,^ + Aj./ is the wave operator on M". 

An inspection of the arguments of Sections 4-5 shows that the results there 
remain valid in the Helmholtz case. In particular. Theorem 4.2 and Lemma 
4.3 hold true in the Helmholtz case as they stand. To formulate an analog of 
Proposition 5.1, consider the following interior transmission problem for an open 
ball -Be(O) C M" of radius e > centered at the origin, and an arbitrary constant 
potential 5 > 0, 

(Po-A)i; = in 5,(0), 
{Pq - \{l + 6))w = Q in 5,(0), (6.2) 
v-we H^\B,{<d)). 

Proposition 6.2. Assume that for any e > and 5 > 0, there exists a non-zero 
real transmission eigenvalue for (6.2). Then there exists an infinite set of real 
transmission eigenvalues for (6.1). 

7. Examples 

7.1. The biharmonic operator. As an example of a higher order operator to 
which our conditional existence results apply, we shall consider the biharmonic 
operator in M^, which arises, e.g., in the study of thin elastic plates. 

Proposition 7.1. Let Pq = on M.^. Then the problem (6.1) has an infinite 
set of real transmission eigenvalues. 
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Proof. When proving this resuh, we shall apply Proposition 6.2. It therefore 
suffices to prove that the problem (6.2) has a non-trivial solution for arbitrary 
e > and 6 > 0. Without loss of generality, we may assume that 6 is sufficiently 
small. Let k = \^/\ ks = (A(l + and 

p = ^ = (1 + Sy/' = 1 + 7 + 0(5'), < 5 « 1. (7.1) 
k 4 

Then writing 

- A;"^ = (A - A;2)(A + k^) = (A + P)(A - A;^), 

and for A^ — kj similarly, one sees that a reasonable ansatz for v and w in (6.2) 
is 

v{x) = aijo{kr) + a2io{ikr), w{x) = asjo^ksr) + a4jo{iksr), 

where jo is the spherical Bessel function of order zero, and aj are constants. Our 
boundary conditions now take form 

d\'' 

^ j {aijoikr) + a2jo{ikr) - asjo{ksr) - aJo{iksr))\r=e = 0, / = 0, 1, 2, 3. 

(7.2) 

Using the known asymptotics for jo{ke) and jo{ike) and their derivatives, as 
k — oo, one sees that the deteminant of the linear system (7.2) is 



d 



£ ^ k ^ 2£ ^ k £ ^ k 2£ ^ k^ 

(9(1) tfl + oie'^') hA^Bit^ + Oil) -^ + Oie' 



._L,<«..,.^ , 0(1,) . 

where di is given by 

(p — 1) sin(A;e) — {I + p) cos{ke) [p — 1) sm.{kse) + (/? + 1) cos{kse) 

-{p^ + p + 2) cos{ke) + (p2 + p) sin(A;e) {2p^ + P + 1) cos{kse) - (p + 1) sin(/c5e) 

Using (7.1), we get 

di = 4sin((p-l)te) + 0((5). 

Hence, to show that the linear system (7.2) has a non-trivial solution, it suffices 
to check that the function 

sin((p-l)fe) + 0(5) + 0(^) 

has real zeros, for k large enough. The latter is clear, however, from the period- 
icity of the function 

k sin((p — l)ke). 
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We may also notice that the minimal period of this function is 
This completes the proof. 



□ 



7.2. The Dirac system. Our approach generalizes also to many systems. We 
demonstrate this here by carrying out the analysis in the case of the Dirac system. 

The free Dirac operator in is given by the 4x4 matrix 

a- 
a-D 



where D = — iV and cr = (cri, a2, c^) is a vector of Pauli matrices with 

l\ fO -A fl 



The most important property of the Dirac operator is the following one, 

Co{Df = -Ah, 
where J4 is the 4x4 identity matrix. 

Let f2 C be a bounded domain in with a connected C°°-smooth boundary. 
It is known [22] that when equipped with the domain 

the Dirac operator Cq is self-adjoint on 
Notice that 

Hl{nf X H\^lf C V{Co). 
However, in general, V[Cq) is strictly larger than the Sobolev space HliVtY x 
H^{VlY, see [25] for the discussion and a precise example. 

Let V{x) be an Hermitian 4 x 4-matrix- valued function whose entries belong to 
L°°(M^). An application of the Kato-Rellich theorem shows that the operator 
Cq[D) + is self-adjoint on V{Cq). Assume that is not in the spectrum of 
Cq{D) + V. Then it was shown in [22, 24] that for any / G H^'^{dnf, the 
boundary value problem 

(£oP) + V^)w = 0, in fi, 
n+ = /, on dVL, 

has a unique solution u G H^iVtY. The set of the Cauchy data for (7.3) is given 
by 

{(w+lan? M-|an) : u G H^iytY is a solution of {Cq{D) + V)u = in 



TRANSMISSION EIGENVALUES 15 

Assume now that supp (V) = Q. The interior transmission problem for the Dirac 
operator is the following boundary value problem, 

(£o(^) - >^h)v = in n, 

{Co{D)-\{h + V))w = in n, (7.4) 

v-we H^{n)\ 

We say that A G C is a transmission eigenvalue if the problem (7.4) has non- 
trivial solutions V E Lf^^{Q)^ and w E L^^^^Qy. It suffices to require 
that V ^0. 

Notice that A = is a transmission eigenvalue and the space of functions 

{v ^ : Co{D)v = 0} 

is infinite dimensional. 

Remark 7.1. The standard electromagnetic potential for the Dirac operator given 
by 

V = Co{A) + Q, 

with 

Q=(%^'^°jJ, A=(ai,a2,a3)GL-(n;R3), g±GL-(n;R) 
is included in the setup above. 

Throughout this section, we shall assume that V{x) is an Hermitian positive- 
definite 4 X 4-matrix valued function, i.e. there is a constant cy > such that 

{V{x)ri, 7]) > cy|r/p, Vx G H, Vr/ G C^ 

where (■, ■) is the inner product in C^. Moreover, we shall assume that the entries 
of V{x) belong to C°°{Q). Thus, the entries of the inverse matrix V~^{x) also 
belong to C°^(n). 

Arguing as in the earlier sections, we see that the following characterization of 
transmission eigenvalues holds: 7^ A G C is a transmission eigenvalue if and 
only if there exists 7^ n G Hq{QY satisfying 

Txu={Co-X{h + V))V~\Co-Xh)u = in V'{n)\ 

Here 

Tx = A-XB + X^C, 

where 

A = CoV-'Co, 

B = V~^Co + 'CoV~' + Co, 
C = 1 + V~\ 
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Proposition 7.2. The operator A is symmetric and positive on when 
equipped with the domain C^{Q)'^, in the sense that there is d = dv,n > such 
that 

Proof. Let (f G C^{^)^. Then we get 

(Av9,v9)i2(j^)4 = {V~'^ Coif, Coif) L2(^n)^ > cv\\Coip\\l2^Q)4 > d\\ip\\l2^Q)4. 
Here the last inequahty follows from the estimate [15, Theorem 10.3.7] 
W^o^h^iny > cn\\'^\\mn)'i, G C^(fi)^, > 0. 

The claim follows. 

□ 

Proposition 7.3. The second order operator A is uniformly strongly elliptic in 
the sense that there is c> such that 

{a{A){x,Ov,v)>c\^\'\v\', a; en, ^ e M^ e C^ (7.5) 
where cr{A) is the principal symbol of A. 

Proof. In view of homogeneity of (7.5) it suffices to prove it for |^| = 1 and |?7| = 1. 
Let rj = {rj^, rjJ)^ G C. Then since is an Hermitian positive-definite matrix 
valued function, we have 



> Cy 



> 0. 



^■e=(, ^'7^'), det(a.o = -ier = -i. 



□ 



The latter inequality follows from the fact that 

This proves (7.5). 
Proposition 7.4. The operator A, equipped with the domain 
is a positive self-adjoint operator on L'^iVtY . 

Proof. We shall consider the Friedrichs extension of A on C^(f2)^, denoted also 
by y4, which has the domain 

V{A) = V{Q)nV{A^,.,^). 
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Here 

is the quadratic form associated with the operator A. The domain T>{Q), also 
the form domain of A, is the completion of C^{Q)'^ with respect to the norm 
III III = a/Q(v5, v^)- The maximal realization Amax of the operator A is defined by 

2^(^max) = {ue L\ny : Au e L\nY}. 
Let us now show that 

ViQ) = H',iQ)\ (7.6) 
Indeed, it is easy to see that the norm ||| ■ ||| is equivalent to the following norm 

11-^^0 ■ ||L2{n)-i + II ■ ||L2(f7)4. (7.7) 
Since \\Cq ■ ||L2(f7)4 < C|| V ■ ||L2(t^)2, we have 

H',{n)' C V{Q). 

On the other hand, it follows from [22, Proposition 4.2] that the completion of 
C°°(n)'^ with respect to the norm (7.7) is the space 

Thus, 

V{Q)GH{n). 

It is shown in [22, Proposition 4.6] that the trace map 

r : C~(n)^ ^ C°°(9^])^ u^u\an, 

extends uniquely to a bounded map on T-iiyt). It follows from [22, Proposition 
4.6] that for any u G T>{Q), tu = 0. Hence, [22, Proposition 4.10] implies that 
u G Hq^Q)'^. This proves (7.6). 

Hence, 

V{A) = {ue H^in)^ : Au G L''{n)^}. 

As the operator A is strongly elliptic and Q has a smooth boundary, by elliptic 
regularity, see for instance [13, Section 7.5], V{A) = H^iQ^ n H^^n)"^. 

□ 

It follows from Proposition 7.4 that for any A G M, the operator Tx, equipped 
with the domain 2^(A) is a self-adjoint operator on L^(f2)^, and the form domain 
of Ta is H^{n)\ 



Theorem 7.5. The set of transmission eigenvalues for (7.4) is discrete. 
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Proof. First note that the operator 



-XB + X^C 



V{A) L^n) 



is compact. Hence, the operator Tx : — L^(fi) is Fredholm of index 0, 

invertible at A = 0. Thus, by analytic Fredholm theory. 



is a meromorphic family of operators with residues of finite rank. This proves 
the claim. 



As before, we see that the multiplicity of a transmission eigenvalue A G M is finite. 

Theorem 7.6. Let V be a matrix-valued potential as above. Then there exists 
an infinite set of real transmission eigenvalues for (7.4). 

Proof. First notice that Proposition 6.2 continues to be valid for (7.4). It is there- 
fore sufficient to prove the existence of transmission eigenvalues for the following 
problem. 



Here e > 0, 5 > and i?e(0) C is an open ball of radius e centered at the 
origin. 

When considering (7.8), we let 7^ A G M and study 



T^^ : L\n) ^V{A), AgC, 



□ 



{Co{D) - Xh)v = in 5,(0), 
iCo{D)- X{l + 6)h)w = in 5,(0), 



(7.8) 



{Co{D) - Xh)v 







where 




Then we have 



— Af+ + cr ■ Dv 

a • Dv+ — Xv 



0, 
0. 



As 
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we get 

vl = ^{D;v\ + {D^-iD2)vl) 

vl = j{{Di + iD2)it - D^vl), 

-A - \ U\ _ 

-A-X^JXvl)- 

Considering the equation 

(£oP)-A(l + 5)14)^ = 0, 

similarly, we obtain 

vol = TTz^-^iDswl + {Di - iD2)wl) 



A(l + 5) 



,2 _ 1 ^^n , „-n ^„„l n „,,2 ■ 



0. 



\{l + 5) 

-A-A2(l + 5)2 Wu;i 

-A- A2(l + 5)2j l^u;2 

Notice that to prove the existence of real transmission eigenvalues for the problem 
(7.8), it suffices to restrict our attention to solutions v,w of (7.8) such that 
v\ = v1 = f{r) and w]_ = = g{r), r = \x\, are spherically symmetric 
solutions of the following interior transmission problem, 

(_A-A2)/ = in 5,(0), 

{-A -X\l + 6^)9 = in BM, 

f-9 = on dBe{0), (7-9) 

drf = -^, on dBM- 

1 + 

It is clear then that for such solutions, the boundary conditions 

vl = wl on dBeiO), 
vl 

are satisfied. 
Since 

(A + A2)/(r) = fir) + -/'(r) + \'f{r) = 0, 

r 

/ must be of the form 

fix) = Cojo(Ar), 

where jo is the spherical Bessel function of order zero and cq is a constant. In 
the same way, 

g(x) = cijo(A(l + 5)r), 



•2 - wl on dB,{0). 
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The boundary conditions in (7.9) require that 

Cojo(Ae) = cijo(A(l + 
coJo{\e) = cij'oi\il + 5)e). 

A nontrivial solution of this system exists if and only if 

det('f'\ -'f^]tf'^^=0. (7.10) 



Since 



jo{r) = m = ^-^ + o{iy 



(7.10) implies that 

sin(Afe) + C(l/A) = 0, A ^ oo. (7.11) 

The existence of an infinite set of values A such that (7.11) holds is clear as 
sin(A(5e) is a periodic function taking positive and negative values. Each such A 
is a transmission eigenvalue for (7.8) and this completes the proof. 

□ 



8. Generalized Rellich theorem 

In the last two sections, which do not depend on the material in Section 6 and 7, 
we would like to explain the connection between interior transmission eigenvalues 
and scattering theory. It is going to be provided by a generalization of the classical 
Rellich theorem, proved in [17]. 

Let us start by summarizing the basic features of general scattering theory fol- 
lowing [15, Chapter 14]. Let Pq be a partial differential operator in of order 
m > 2 with constant real coefficients, 

PoiD) = J2 e M, = -i^, J = 1, . . . , n. 

Assume that A(Po) = {0}, see (2.4), and that Pq = -Po(-D) is simply characteristic, 
i.e. 

E i^o"Hoi<c(Ei^o"^(^)i + i)' c'>o. 

|a|<TO |a|<l 

Examples are hypoelliptic operators [15, Chapter 11] and operators of real prin- 
cipal type [14, Chapter 8]. 

In order to describe mapping properties of the boundary values of the L^-resolvent 
of Po, we follow [15, Chapter 14] and introduce the following Banach spaces. 
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Define 



B = {ve L\W) : \\v\\b = J2^y^^ / l^'l^dxY^^ < oo}, 

j = l ''^3 

B* = {u e Lf„,(M") : Hulls, = snpR~^^\ I \u\^dxf'^ < 00} 



i>o Jnj 



where 



i?o = 0, R, = 2^~\ j = l,2,..., 
VLj = {x e M" < |x| < Rj}, J = 1, 2, ... . 

The space B* is the dual of B and we have 

LldBdL^ dB* d Lis, ^ > 1/2. 



The space of C(j"-functions is dense in B but not in B*. Its closure in B* is 

o o 

denoted by B*. Then u G ^^^^(IR") belongs to B* if and only if 



We also define the Sobolev space version of B*, associated to Pq{D), 



For z E C^\Z{Po), the resolvent Ro{z) = [Pq — zl) ^ of the simply characteristic 
operator Pq extends to a continuous map 



Here = {z : ±Im z > 0}. For A G M \ Z{Pq), the boundary values of the 
resolvent are given by 



where F stands for the Fourier transformation. 

We say that u d B* is outgoing (incoming) if m = R{X + iO)f {u = R{\ — iO)f), 
f d B and A G M \ Z{Pq). If u is outgoing or incoming then {Pq — \)u = f. 

For A ^ Z(Po), the level set Ma = G M" : Po(0 = ^} is an {n - 1) -dimensional 
submanifold of M". 

It is known that u is both outgoing and incoming, i.e. u = R{X + iO)f = 
R{X - iO)f, if and only if F{f) = / = on Ma. 




B*p^ = {u G B* : Pq p)n G P*,Va}. 

Let Z{Pq) be the (necessarily finite) set of critical values of Pq, i.e. 

Z{Po) = {A : 3^ G s.t. VPo(0 = 0,Po(0 = A}. 



Po(^) -.B^B 



Po(A ± zO)/ = lim P-^((Po -\T eiy'Fif)), 
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We shall consider multiplicative perturbations of Pq given hj V E L°°(M'") with 
compact support. Such perturbations satisfy the short range condition introduced 
in [15, Section 14.4], i.e. 



V:B*p^-^B 



is compact. 



In order to define the scattering amplitude, we recall the following fundamental 
result [15, Theorem 14.6.8]. 

Theorem 8.1. Assume that A G M \ Z{Po). If u G Bp^^ satisfies 

{Po + V - X)u = 0, 

then 

u = u± - Ro{X T iO)Vu (8.1) 

where 

u± = v±5{Po — A) = ^^'dzT757| 'J'lT'd v± G L?{Mx, dS). 

I "ol 

The map V- ^ Vj^ is a continuos bijection which extends to a unitary map 

Pol Pol 

We call u_ the incoming wave and f + the outgoing wave. The unitary map is 
the scattering matrix for the energy A and 

= / - Sa 

is the scattering amplitude. 

The following result is well-known and its proof is included for completeness only. 

Lemma 8.2. Assume that A G M \ Z{Po) and u G B*p^^ satisfies the equation 
(Pq + V — \)u = 0. Then the scattering amplitude Ax can be expressed through 
the Fourier transform of Vu as follows, 

Proof. By [15, Theorem 14.6.8], we get the following Lippmann-Schwinger equa- 
tion for u, 

u = u± — Ro{\ =F iO)Vu 

where 

dS 

u± = v±6{Po - A) = v±— and v± G L^{Mx, dS). 

Pol 

Thus, 

u+-U- = {Ro{\ - iO) - Ro{\ + iO))Vu. 
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Applying the Fourier transform, we have 

dS X 1 



P'\ 



that proves the claim. □ 

In order to describe the connection between transmission eigenvalues and the 
scattering amplitude, we shall now review the generalized Rellich theorem. Recall 
that a classical theorem of Rellich states that if v satisfies (A + k'^)v = for 
|x| > Rq and v{x)\x\^"'~^'^^'^ — )■ as x — ?■ oo, then v{x) = for |x| > Rq. 

A far-reaching generalization of this result to broad classes of differential opera- 
tors with constant coefficients has been given in [17]. Let us now state a much 
simplified version of [17, Corollary 3.2]. See also [1]. 

Theorem 8.3. Assume that A is not a critical value of Pq{^), ^ G M", and that 
there is a factorization 

Po(c)-A = cpr(c)---^'r(c), ceR, 

for which every factor Pj(C) has real coefficients and is algebraically irreducible 
over C". Assume furthermore that each Pj(C) has a non-empty set of real zeros. 
If u E S' n Lf^^ is a solution of 

{Po{D) - \)u = /, (8.2) 

o 

with f G Ll^^p and u eB* , then u has a compact support and 

chsupp (u) = chsupp (/), 
where ch stands for the convex hull. 

Remark 8.1. If Po(C) ~ ^ has an irreducible factor which has no simple real zero, 
then it was furthermore proved in [17] that for any integer one can find u G 
nC°° satisfying (8.2) with / being compactly supported and u{x) = o(|x|~^) 
but u not compactly supported. 



To illustrate the main ideas involved in the proof of Theorem 8.3, for the con- 
venience of the reader, we shall include a proof of the special case when k = 1, 
m = 1 and c = 1 . In doing so we shall follow [1 7] closely. 

Proof. Set Pa(C) = -Po(C) ~ -^j C ^ C". The set of real zeros of the polynomial 
PxiO is equal to Ma = G M" : Pa(0 = 0}. By the hypothesis of the theorem. 
Ma 7^ is an (n — l)-dimensional submanifold of M" . 
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Let ^0 ^ Mx. Assume, as we may, that d^^Po{C,o) ^ 0, and write ^ = (C^n) £ 
M", ^' G ]R"~^. By the imphcit function theorem, there is an analytic function 
g : M"-i R, g{C) = J2 ^aiC - CoT, defined locally near Co, such that 

locally near ^ Mx. Hence, the series g{C) = Yl (^a{C " io)°' also converges for 
C G C"-^ near 

Let be the zero set of Px in C^, i.e. 

= {C G C" : Pa(C) = 0}. 
Then let us show that locally near C,o, we have 

M^ = {{C',g{C')):CeC"-'}. 

Indeed, Px{C g{0) = for any ^' G M"~^ near and, hence, since Pa and g are 
analytic, we get that Px{C, 9{C)) = for any (' G C"""*^ near ^q. 

Now since u gP*, the Fourier transform / vanishes on Mx (cf. [15, Theorem 
14.3.6]). Thus, by the analyticity of / and g, we have that / vanishes identically 
on an open neighborhood of .^o iii • 

Denote by 

A = {C G C" : /(C) = 0} 

the set of the complex zeros of /. Notice that the sets A and Mx are analytic. 
As we have assumed that Pa(C) is algebraically irreducible over C", the set 
is algebraically irreducible, and hence it is analytically irreducible as well, [26]. 
Moreover, A fl contains an open neighborhood of .^o in ^a • Then it follows 
from [7, Corollary 2, Section 5.3] that 

C A. (8.3) 

Thus, the function 

/(C) 

^a(C) 

is entire in C". An application of [14, Theorem 7.3.2] shows that there exists 
V G Ll^rnp such that 

Px{D)v = f. 

Hence, 

PxiD)iu-v) = 0, 

o 

and since u G-B*, [14, Theorem 7.1.27] implies that u = v. □ 
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9. Injectivity of the scattering amplitude and transmission 

eigenvalues 

In this section we shall assume that the operator Pq is hypoelliptic and A G M is 
such that Pq — X satisfies the assumptions of Theorem 8.3. Let V G L°°{W^) be 
real-valued compactly supported in M" with supp {V) = Q, where C M" is a 
bounded convex domain which is of class C°°, and V > 6 > a.e. in Q. 

Consider the interior transmission problem, 

(Po - A)i; = in n, 
{Po + V-X)w = in fi, (9.1) 

Theorem 9.1. There is a solution {v,w) of (9.1) with ^ v ^ B* if and only if 
the scattering amplitude Ax is not injective. 

Proof. Assume that Ax is not injective. Then there exists a solution u G Bp of 
(Po + V — X)u = in R" such that u = — Ug with n_ 7^ and the scattered 
wave 

Us := Rq{X + iQ)Vu 

being both incoming and outgoing. By the mapping properties of the resolvent 
-Ro('^ + «0) : B ^ Bp^^, we see that m_ G Bp^. Now since the scattered wave 

o 

Us is both incoming and outgoing by Theorem [15, Theorem 14.3.6] Us G-B*. 
Moreover, {Pq — X)us = Vu. Now Theorem 8.3 implies that Us has compact 
support and supp (n^) C Q, thanks to the convexity of Q. Since u,Us G Lf^^(W^) 
and Po is hypoelliptic, by hypoelliptic regularity [15, Theorem 11.1.8], we have 
that Us G P^°|;^(M"). As supp (u,) C Q, a regularization argument shows that Us 

can be approximated by a sequence of C^(fi)-functions, so that n^ln G iJ(f"(r2). 
Now setting v = u^\q ^ and w = u\q, we get a nontrivial solution to (9.1) . 

Assume conversely that the problem (9.1) admits a non-trivial solution {v,w) 
with 7^ w G B*. Then by [15, Theorem 14.3.3], we have v = v^dS with 
f_ G L^{Mx,dS). Since Pq is hypoelliptic, the surface Mx is compact, and thus, 
[15, Theorem 14.3.8] implies that v G Bp^. As v — w G HQ°{n), we get that 

O 

w G B*p^ and v - w eB*. Now (Po - X){v - w) = Vw and [15, Theorem 14.3.6] 

yields that the Fourier transform Vw = on Mx- Hence, applying Lemma 8.2, 
we get that AxV- = 0. □ 

Remark 9.1. The convexity assumption on Q can be removed if we require that 
Pq is elliptic and M" \ f2 is connected. 
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